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Abstract 

We consider two-variable first-order logic on finite words with a fixed number of 
quantifier alternations. We show that all languages with a neutral letter definable 
using the order and finite-degree predicates are also definable with the order pred¬ 
icate only. From this result we derive the separation of the alternation hierarchy 
of two-variable logic on this signature. 


1 Introduction 

Finite model theory and the lower classes of circuit complexity are intricately interwoven. 
In the context of circuit complexity, logics are considered over finite words with arbitrary 
numerical predicates. Intuitively, we allow the use of any predicate that only depends on 
the size of the word. A first result from Immerman provides an equivalence between 
languages definable by first-order logic enriched with arbitrary numerical predicates on 
the one hand, and languages computable by families of circuits of constant depth and 
polynomial size on the other. Since then, several meaningful circuit complexity classes 
have been shown to be equivalent to logical fragments mm- It is therefore possible to 
obtain deep and interesting inexpressibility results by using circuits lower bounds. 

For instance, by using a famous lower bound for the parity language [5], Barrington, 
Compton, Stranding and Therien [T] showed that the regular languages definable in 
first-order logic with arbitrary numerical predicates are definable with only the regular 
predicates. Relying on an algebraic description of first-order logic with regular predicates, 
it is possible to decide the definability of a regular language in this logic. 

Conversely, it is tempting to use finite model theory methods to compute circuit lower 
bounds. This approach has achieved relative success for uniform versions of circuit 
complexity classes. For instance, Roy and Straubing provide a separation result for 
the long-standing question of the separation of ACC from NC^ in a highly uniform 
setting m- In these settings, this uniformity condition has two different interpretations: 

1. In the circuit framework, it is a restriction on the complexity of the wiring of the 
gates. 

2. In the logical framework, it is a restriction on the class of numerical predicates 
considered in the fragment. 

In order to deal with the combinatorics of arbitrary numerical predicates, the languages 
with a neutral letter have been introduced in [5]. Formally, a language L has a neutral 
letter c if for any pair of words u,v, we have ucv S L if, and only if, uv £ L. Less 
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formally, this letter c can be added or removed anywhere in a word without changing 
its membership to L. The underlying idea was that numerical predicates would be 
essentially useless in the presence of a neutral letter. This was made formal through the 
Crane Beach conjecture: 

Every language with a neutral letter definable in first-order logic with arbitrary nu¬ 
merical predicates is definable in first-order logic with the linear order only. 

Furthermore, some of the most interesting languages, such as the parity language, 
possess a neutral letter. Unfortunately, this conjecture has been disproved in the arti¬ 
cle [2] in the context of first-order logic, as long as the Bit predicate is in the signature. 
This result prevents the use of this approach to obtain circuit lower bounds for more 
expressive classes. However, for fragments of first-order logic the Crane Beach conjec¬ 
ture is still of interest. For instance, the Crane Beach conjecture holds for the fragment 
without quantifier alternation [5]. 

Turning to other fragments, two-variable first-order logic is a robust and well-studied 
class that offers a wide range of long-standing and intriguing open questions. It is 
not know whether the Crane Beach conjecture holds for this fragment. This question 
is related to a long-standing open linear lower bound for the addition function, since 
two-variable logic is equivalent to linear circuits of AC° [5]. Therefore, if the Crane 
Beach conjecture holds, then the addition function is not computable by a constant- 
depth linear-size circuit family. This result would improve on a known lower bound for 
addition that states that addition is not computable by circuits of constant depth with a 
linear number of wires [5] . We remark that lower bound for addition has been discussed 
and informally mentioned several times [M 111 m IH] and formally stated in the article [71 
Open problem 23]. 

In this paper, we focus on the case of two-variable logic, which is poorly understood 
in this context. We first prove that languages with a neutral letter definable in two- 
variable logic with arbitrary numerical predicates can be defined allowing only the linear 
order and the following predicates: 

1. The class jF of finite-degree predicates, that is, binary predicates that are relations 
over integers and such that each vertex of their underlying infinite directed graph 
has a hnite degree. 

2. The predicate MSBq dehned as follows. The predicate MSBq is true of x and y if 
the binary representation of y is obtained by zeroing the most significant bit of x. 
More formally 


MSBq = {{x,x — 2*) I a; e N, and i = [log(a;)J} . 

As an intermediate step toward a better comprehension of the Crane Beach conjecture 
for FO^, we propose to study the relationship between < and T, and present a Crane 
Beach result which is thus one predicate shy from showing the Crane Beach conjecture 
for FO^ over arbitrary numerical predicates. 

The main result of this paper is a proof of the Crane Beach conjecture for each layer 
of the alternation hierarchy of the two-variable first-order logic equipped with the linear 
order and the finite-degree predicates. 

Note that the general arbitrary numerical predicates in the statement would entail a 
long standing conjecture on the circuit complexity of the addition function. Thus, this 
result can be viewed as a uniform version of this circuit lower bound. This result imme¬ 
diately implies that this hierarchy is strict. This provides, to the best of our knowledge, 
the first example of a Crane Beach conjecture that applies to each level of an alter¬ 
nation hierarchy. Ramsey’s Theorem for 3-hypergraphs will be our key combinatorics 
tool. This theorem indicates that the Crane Beach conjecture for FO^ hinges on the 
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interaction between finite-degree predicates and the predicate MSBq. 

On the two-variable restriction: 

It is already known that the first-order logic with the “-I-” predicate satisfies the Crane 
Beach conjecture. Furthermore, the MSBq predicate is definable in first-order logic with 
the predicate “-I-” and the unary predicate {2“ | x € N}. The proof of the Crane Beach 
conjecture for “-I-” predicate can be augmented to handle this extra unary numerical 
predicate. Therefore, we deduce that the first-order logic with the order and the MSBq 
predicate also satisfies the Crane Beach conjecture. 

The case of finite-degree predicates is more intricate. Indeed, even if this class of 
predicates satisfies a form of locality, it is still not known if the Crane Beach conjecture 
hold for FO[<, J^]. This class contains numerous expressive numerical predicates as 
the translated bit predicate which is true in positions (x, y) if the {y — x)*^ bit of x is a 
one. The Crane Beach conjecture may holds for finite-degree predicates but the classical 
proof, e.g. eollapse on active domain, seems to fail [2 Haim. 

Organization of the paper: 

Section[2is dedicated to the necessary definitions. In Section[3]we present an Ehrenfeucht- 
Frai'sse game adapted to our context. We present in Section 0] our main result with 
immediate corollaries. The final section is dedicated to the proof. 

2 Definitions 

A finite word u = uq- ■ -Un-i of A* is represented by a relational structure on the set 
{ 0 , • • • , n — 1} over the vocabulary consisting of the letter predicates {a | a € A} and 
of the numerical predicates. On the one hand, the letter predicate a is interpreted as 
the subset of all the positions labelled by the letter a. On the other hand, a numerical 
predicate interpretation only depends on the size n of the input word. Therefore, an 
interpretation of the predicate symbol P of arity fc is a sequence P = {Pn)n, where 
Pn C {0,... ,n — 1}^. Note that P is a syntactic object, while P is its interpretation. 
Furthermore a numerical predicate is said to be uniform if it can be seen as a relation on 
integers. More precisely, a numerical predicate P = {Pn)n of arity k is uniform if there 
exists an integer relation Q C satisfying Q O {0,..., n — 1}^ = Pn- From now on, we 
do not distinguish numerical predicates from their interpretation and uniform predicates 
are seen as relations on integers. The class of all numerical predicates is denoted by Arb. 
Remark that the word uniform in this context is not related to the classical notion of 
uniformity in circuit complexity. 

Examples: 

• The classical predicates x<y or x + y = z and xy = z are numerical predicates 
and are uniforms. 

• The predicate x + y = max, where max is the last position of the word, is not 
uniform. 

The logical formulae we consider are the first-order formulae over finite words. They 
are obtained with the following grammar: 

ip = a(x) I P(xi, ...,Xk)\p^p\^p\^^xp . 

Here x, Xi, X 2 , X 3 ,... denote first-order variables, which are interpreted by positions in 
the word. The letter predicate a(x), is interpreted by “the letter in position x is an 
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a,” and P(xi,... ,Xk), is interpreted by “the predicate P is true on {xi,. .. ,Xk)-” As 
usual, the Boolean connectives A and -■ are interpreted by “and” and “not,” respectively, 
and da: as a first-order existential quantification. We use the standard notation u \= ip 
to signify that the word u satisfies the formula ip. We also denote by u |= if the 
formula ip{x) is true when its free variable is interpreted by the integer i < |it|. The 
quantifier depth of a formula is the maximal number of nested quantifiers. 

Let P be a class of numerical predicates. We denote by FO[P] the class of hrst-order 
formulae that use numerical predicates in V. We also denote by FO^[P] the subclass 
of formulae of FO [V] that use only two variables but allows the reuse of them. We say 
that a language L is definable in a fragment of logic if there exists a formula in this 
fragment such that L is the language of words satisfying this formula. 

Example: 

The language A*aA*bA*cA* can be described by the first-order formula 
3x 3y 3z X < y < z A a{x) A b(?/) A c{z) . 

This formula uses three variables x, y and z. However, by reusing x we can rearrange it 
so that it uses two variables: 

3a; a(a;) A (3y x < y A h{y) A (3a; y < x A c(a;))^ (1) 

The alternation hierarchy of FO^ is also of interest here. To define formally the 
number of alternations of a formula, it is not possible to use prenex canonical normal 
form obtained by applying DeMorgan’s laws to move negations past conjunctions, dis¬ 
junctions and quantifiers. Indeed, these constructions increase the number of variables. 
That said, the number of alternations is still a relevant parameter that could be defined 
as follows: Consider the tree naturally associated to a formula, as the grammar previ¬ 
ously exposed. For instance, formula m has “3” as a root and the atomic formulae as the 
leaf. In a two-variable first-order formula we count the maximal number of alternations 
between the root and the leaves once the negations have been pushed on to the leaves. 
A more precise definition could be found in the article [H]. We denote by FO^['P] the 
formulae of FO^[P] that have at most k quantifier alternations. The hierarchy induced 
by FO^[<] is known to be strict [12] and its membership problems is decidable [T^fT^ . 
Without loss of generality, we will always consider two-variable logic over predicates of 
arity at most 2. 


3 Ehrenfeucht-Fraisse game 

One of the important tools for proving our main result is the Ehrenfeucht-Fraisse game 
for two-variable logic. It is often used in the context of finite model theory to show 
certain inexpressibility results. Libkin’s book |15] provides a good exposition. In this 
section, we present the Ehrenfeucht-Fraisse game and briefly sketch a proof that the 
Crane Beach conjecture holds for FO^[<,-|-l]. This could be easily proved by using 
some algebraic descriptions of FO^[<,-|-l] obtained by Kufleitner and Lauser [T3] but 
we prove it using Ehrenfeucht-Fraisse game as an introduction to our general result. 

In the context of two-variable logic with a bounded number of alternations m and 
quantifier depth s, the associated Ehrenfeucht-Fraisse game is defined as follows: 

• The game is played by two players: Spoiler and Duplicator^ on two relational 
structures. In our case, the relational structures are associated with the words 
u and V equipped with the letter predicates and a finite number of numerical 
predicates. 
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• The first round starts with Spoiler, who chooses either u or v and plays by putting 
a pebble on a position. Then Duplicator chooses the other word and puts a pebble 
on one of its positions. 

• The subsequent rounds proceed as follows: each word is labelled by at most two 
pebbles. First, the two oldest pebbles are removed. Then, Spoiler plays on one 
structure and Duplicator on the other. If the relational structures induced by the 
two pairs of pebbles are not isomorphic, Spoiler wins. 

• During all the game. Spoiler can change at most m times between the two words. 
Duplicator wins the game if he did not loose the game before the end of the 
round. 

We say that Spoiler has a winning strategy if he has a strategy that allows him to win 
the game whatever Duplicator plays. The following theorem is a well-known result that 
could be easily adapted, for instance, from the book [El- 

Theorem 1. A language L belongs to FO^[P] if and only if there exist predieates 
P^,... ,P* € V and s S N so that for any words (u, v) G L x L‘^ Spoiler has a winning 
strategy for the two-pebble game with s rounds and m alternations on (u, v) over the 
predieates ..., P‘. 

This theorem is our main interface to logic in order to establish Crane Beach-like 
results. The proof method we are going to sketch is a rather classical back-and-forth 
construction. As we mention before, the next result is also a direct consequence of 
known algebraic characterisations of these fragments |13) . 

Proposition 2. For any m, languages with a neutral letter in FO^[<, -|-1] are definable 
in FO^[<]. 

Sketch of proof. Let L be a language definable in FO^[<,-|-l] and assume that it has 
a neutral letter c. Thanks to Theorem [U there exist integers s and k ^ m such that 
Spoiler has a winning strategy for the two-pebble game with s rounds and k alternations 
on {u, v), with (zi, v) G L x . We construct two words u' and v' by inserting 2s letters 
c between each position (including the beginning and the end of the words). As c is a 
neutral letter, we have {u',v') G L x and therefore Spoiler has a winning strategy 
for the two-pebble game with s rounds and k alternations. Remark that the successor 
relation on (u',v') is useless since the non-neutral letters are not reachable from each 
other in less that s rounds. Therefore one can translate the Spoiler’s wining strategy 
on {u',v') on a wining strategy that does not use the successor relation. This wining 
strategy can then be translated in a wining strategy on (u, v). We then conclude thank 
to Theorem [T] □ 

4 Main Result 

We now investigate the Crane Beach conjecture in the specific case of FO^ equipped 
with numerical predicates of finite degree. Throughout this section, we borrow from the 
vocabulary of graph theory in order to express properties on the structure of numerical 
predicates. Indeed, a binary numerical predicate can be understood as a family of 
graphs. Furthermore, if the predicate is uniform, it can be viewed as a single infinite 
graph where the set of vertices is N. Let P be a uniform numerical predicate. The degree 
of a position k for P, denoted by dp{k), is the size of the set of all integers connected 
to k via P. More formally 

dpik) = I {j I (fc, j) e P or (j, fc) G P} I . 
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The notion of locality is one of the most effective tools for using the Ehrenfeucht- 
Frai'sse games. One way of introducing locality is to restrict the degree of the signature. 
A uniform binary predicate P has a finite degree if all positions have a finite degree. We 
denote by J- the class of binary uniform finite-degree predicates. 

Examples: 

• The predicate kx = y, = y,... as well as the graph of any strictly growing 
function. 

• The translated Bit predicate which is true in {x, y) if the {y — a;)*^ bit of a; is a 
one. 

Example of nonfinite-degree predicates: 

• The linear ordering. 

• The Bit predicate which is true of {x, y) if the y**' bit of x is a one. 

• The MSBq predicate. 

Predicates of finite degree do not include by definition uniform monadic predicates. 
However, all uniform monadic predicates can be encoded as predicates of finite degree. 
If P is monadic and uniform then Q = {{x,x) \ x € P} is a finite-degree predicate. 

The next theorem states that the Crane Beach conjecture for FO^[Arb] reduces to 
solving the Crane Beach conjecture for the order, the MSBq predicate and the class of 
finite-degree predicates. The proof of this theorem is an adaptation of a circuit-version 
of a similar result m- Because of the lack of space, the proof of this theorem is omitted. 

Theorem 3. Any language with neutral letter definable in FO^[Arb] is definable in 
F02[<,jr, MSBo]. 

Proof. Let be a formula of FO^[Arb] defining a language with a neutral letter. We are 
going to encode the behaviour of tp on a word of size n inside the segment ..., 2* — 

1} where i = [log nj. We separate the segment {0,..., 2*+^ — 1} in four disjoint segments 
of size 2*“^ as follows: 


E-i 


Eq 


{0,..., 2*+i - 1} = {0,..., 2*-i - 1} U {2*-\ ..., 2* - 1} 

U {2\ ..., 2* -b 2*-i - 1} U {2* -b 2*-\ ..., 2*+i - 1} . 


El 


E2 


From now on, i is fixed. Let Xk denotes the position x + k2'^ where x € Eq. Observe 
that: 


2 

3x ^(x) = \J 3x {x € Eq A ^(xfc)) 

k^-l 

2 

Vx'i/^(x) = /\ \/x {x G Eq ^ lp{xk)) , 

k^-1 

where "0 is any formula of FO^[Arb]. The variable x of the formulas on the right are 
relativized to the segment Eq. Note that the formula x € Eq requires to use the linear 
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order as well as the monadic predicate {2" | n G N}. This formula express that there 
exists exactly one power of 2 between x and the end of the word. Formally: 

X G Eo= (^3?/ ?/>a;A?/e{2"|neN}^A 

(Wy [y > X Ay G {2" | n G N}) ^ (Vcc x > y ^ x ^ {2" | n G N})^ 

We perform this transformation on all the quantifications of if and obtain a new formula 
where all variables are relativized to the segment Eq. 

It is quiet possible that some variable Xk encodes a position that is larger than the 
size of the input word. These positions will be handled by considering that they are 
labelled by neutral letters. We introduce two more predicates in E: 

1. The predicate MSBio defined as follows. The predicate MSBio is true of x and y 
if the binary representation of y is obtained by replacing the most significant bit 
of a; by 10. More formally 

MSBio = {(a;,a; + 2 *) | a; G N, and i = [log(a;)J} . 

2. The predicate MSBn defined as follows. The predicate MSBn is true of x and y 
if the binary representation of y is obtained by replacing the most significant bit 
of a; by 11. More formally 

MSBii = {(a;, a; + 2*+^) I X G N, and i = [log(x)J} . 

Now we rewrite the atoms as follows: 

• The atom P(xk, yi) (resp. P{xk)), with P = {Pn) an arbitrary numerical predicate 
is replaced by the atom Qk^i{x,y) (resp. Qk{x)) where Qk,i G T are defined as 
follows: 

Qk,e = {ix,y) I 2* ^ X, j/ < for some i G N and (x + k2'‘~^,y + £2*“^) G P 2 *+i-i} 
Qk={x\2^^x< 2^~^^ for some i G N and x + fc2*“^ G P 2 *+i-i} • 

• The atoms a(xo) is replaced by a(x). 

• For k 0 and if a is a non-neutral letter, then the atom B.{xk) is replaced by the 
formula: 

3j/MSB^j, (x, j/) A a(y) , 
where Z-i = 0, zi = 10 and Z 2 = 11 . 

• For k ^ 0 and if a is a neutral letter, then the atom a(xfc) is replaced by the 
formula: 

(By MSB^^ (x, y) A a{y)) V (Vy ^MSB^^ (x, y)) , 

where z_i = 0, zi = 10 and Z 2 = 11. Intuitively, if the position encoded by Xk is 
bigger than the size of the input word, it is considered as a neutral letter. 

Remark that all the extra indices have been removed during this process and we have 
now a formula of the fragment FO^[<, .F, MSBq]. Furthermore, each step respect the 
semantic of ip, so this new formula defines the same language, which concludes the 
proof. □ 
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We believe that this last theorem does not hold without the neutral-letter hypothesis. 
For instance, the language {uu | m G ^*}, where it is the reversal image of it, is definable 
in FO^ [x y = max] but we conjecture that it is not definable by using only uniform 
predicates, and in particular, using predicates in the signature [<, MSBq]. 

We now focus on the signature [<, .F]. To solve this problem, we will use the locality 
of the class T. Locality is an effective tool which allows us to obtain numerous results of 
non-definability with the help of the Ehrenfeucht-Fraisse games. Unfortunately, as soon 
as the order is present in the signature, it is no longer possible to use locality results 
and the absence of the order makes the fragment far less expressive. We are going to 
show that it is possible to add the order whilst conserving a form of locality when the 
other predicates are of finite degree. 

Theorem 4 (Main Theorem). Let m ^ 0. Any language with a neutral letter definable 
in FO^[<, is definable in FO^[<]. 

We immediately obtain the following corollary. 

Corollary 5. Any language with a neutral letter definable in FO^[<, J^] is definable in 

F02[<]. 

This theorem states the uselessness of finite-degree predicates for defining languages 
with a neutral letter in two-variable logic. More precisely, they do not even improve the 
logical complexity of the languages. Therefore, we immediately deduce the strictness of 
this hierarchy. Indeed, we mainly use the known facts that FO^[<] is a strict hierarchy 
(see m) and that each layer is stable by inverse image of morphisms. This latter fact 
is a requirement for having an equational description as given in the article [12j . Then, 
it is sufficient to take the inverse image of a language L that separates FO^_|_^[<] from 
FO^[<] by a morphism that maps a letter which is not in the alphabet of L to the 
empty word. 


5 Proof of the main theorem 

The principal ingredients are a notion of locality, the Ehrenfeucht-Fraisse games and 
Ramsey’s Theorem. For the remaining of the proof we fix ..., as predicates in 
J-. Our objective is to prove that for any language L with a neutral letter definable in 
FO^[<, P^,, P‘], there exists s such that for every words u G L and v ^ L, Spoiler 
has a winning strategy for the Ehrenfeucht-Fraisse game with two pebbles, s rounds and 
m alternations on {u,v) and over the signature {<,-|-l}. The proof is decomposed as 
follows. 

(1) First, we introduce the notion of a position’s neighbourhood. 

(2) Then, we define an equivalence relation between triples of disjoint neighbourhoods, 
which will allow us to define the different roles that these triples could play through¬ 
out the course of the game. 

(3) We then extract triples of so-called well-typed positions, with the help of Ramsey’s 
Theorem for 3-hypergraphs. 

(4) Finally, we will inductively construct a winning strategy for Spoiler over the signa¬ 
ture {<, -1-1} that uses at most s rounds and m alternations. Proposition [5] allows 
us to conclude. 

Let U C be defined by {x,y} G E if, and only if, x and y are two positions 
connected by one of the predicates. More precisely, {x,y} G E if and only if 

P^{x, y)y P^{y,x)y ■■■y P\x, y) V P\y, a;) . 
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The graph (N, E) is the graph behind our reasoning. As each predicate is of finite 
degree, the graph (N, E) is also of finite degree. From this point on, we assume that the 
integer s (the number of rounds in the game) is fixed. 

5.1 Definition of neighbourhood 

For an integer i, the usual notion of r-neighbourhood is defined as the set of integers 
at distance r from i in (N, A). It captures the intuition that two integers with similar 
r-neighbourhoods cannot be distinguished in r applications of the predicates. Adding 
linear order to the predicates, any element between two given integers is connected by 
the order. Our specialized notion of neighbourhood thus distinguishes between the linear 
order and the other predicates; to this end, let us first introduce the closure of a finite 
set F C N as: 

C1(F) = {minF, min F + 1,..., maxF} . 

Then, intuitively combining at each step the use of the predicates and that of the order, 
we define the 0-neighbourhood of f G N as: 

F(z,0)=Cl(fi}U IJ {k',k}) . 

k'^i^k 

{k',k}eE 

and, inductively, the (r + \)-neighhourhood of i G N as: 

F(z,r + l) = Cl( U V{],r)) . 
jev(i,o) 

Less formally, the 0-neighbourhood of i is the set of positions j such that by moving a 
pebble inside this set it is possible to jump over i. We obtain immediatly that V{i,r) C 
V{i,r + 1). 

Lemma 6. For all integers i and k, V{i,k) is finite. 

Proof. We prove this result by induction on fc. In this proof, we denote by Ej the set of 
neighbours of j in the graph (N, E) for any j € N. We also remark that for F a finite 
set, C1(F) is also finite. 

• First, the 0-neighbourhood of i is finite. For any 0 ^ j ^ i, the set Ej is finite and 
we set 

I 

m = max Ej . 

3=0 

The 0-neighbourhood of i is then included in the segment {0,...,m} which is 
finite. 

• We assume that for any j, the r-neighbourhood of j is finite and we show that the 
(r -|- I)-neighbourhood of i finite as well. By definition 

V{i,r+ l) = C\{ IJ V{],r)) . 

Then by induction hypothesis V{i,0) and V{j,r) are finite sets. Finally the set 

E= U V{j,r) 

jevii.o) 

is a finite union of finite sets. This concludes the proof. 
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We now define the function : N —>■ N by gs{i) = min V (z, s). 

Lemma 7. We have liming(i) = +oo. 

Proof. Suppose for a contradiction that there exist M G N and / C N of infinite size 
such that for any integer i G I, 5s(*) ^ -W- Since I is infinite, there exist n ^ M and a 
set /' C / of infinite size such that for every integers i G I\ we have 5s(*) = n. Thanks 
to Lemma ??, 

/' C V{n, s) . 

A contradiction arises since the set I' is infinite and the set V (n, s) is finite, which 
concludes this proof. □ 

From this we immediately deduce the following corollary, which establishes the pos¬ 
sibility of obtaining an arbitrarily large number of neighbourhoods that do not overlap. 

Corollary 8. For any integer p, there exists A C N of size p such that for any i,j G X, 
the s-neighbourhood of i and j are disjoint and separated by at least one integer. 

An s-extraction is a set of integers, such that their s-neighbourhoods are disjoint 
and separated by at least one integer. In short, they must be in accordance with the 
conditions of Corollary |51 

5.2 An equivalence relation for triples 

We now introduce a notion of similarity for the triples of neighbourhoods taken from 
the Ehrenfeucht-Fra'isse two-pebble game. Let (z_,z,z+) be a triple of integers which is 
an s-extraction. More precisely, this triple satisfies that 

1. i- < i < z+, 

2 . their s-neighbourhoods are disjoint and have at least one element between them. 

According to Corollary |S1 such a triple exists. We set Js{i,i+) as the interval be¬ 
tween the minimal position of the s-neighbourhood of i and minimal position of the 
s-neighbourhood of . More formally, 

Js{i, i+) = {min V {i, s),..., min V (i+, s) — 1} . 

We also set z_|_) the interval in-between the maximal position of the (s — r)- 

neighbourhood of z_ and the minimal position of the (s — r)-neighbourhood of k. More 
formally 


= {maxy(z_, s — r) -I- 1,..., min V (z+, s — r) — 1} . 

These notations are illustrated in Figure [T] Let us take two triples (z_,i,z+) and 
which form two s-extractions with z_ < z < z+ and j- < j < j+. These 
two triples of integers are equivalent if two two-pebble constrained games are similar. 
We define two different notions of constrained games that differ only in their starting 
sets. These games only use two pebbles which are confined, at the r^^ round, to the 
intervals 

and. 

For the first game, the first pebble must be placed for both Spoiler and Duplicator in 
the sets Js{i, i+) and Js{j,j+). For the second game the first pebble is placed by Spoiler 


10 


^{l,s) (*—) *+) 



Js-i{i,i+) 


Figure 1: Neighbourhoods and segments. 


and Duplicator in the sets V{i,s) and V (j, s). If Duplicator wins these two games we can 
state that these two triples are equivalent, which we denote as 

We now introduce formally this definition. We say that (i_, i, i+) (j_ , j, j+) if for 

all s' ^ s Duplicator wins the two following games. They are two-pebble games with s' 
rounds and s' alternation (we consider that Spoiler may alternate as much as he wishes 
between the two words) on the signature {<, ..., P*}, and all positions are labelled 

by the same letter a with the exception of positions i and j which are labelled by the 
same letter b distinct from a. Here is the formal description of the two games: 

(1) For the first game, the first pebble of Spoiler and the first pebble of Duplicator 
are constrained to the set Js'{i,i+) and Js'{j,j+). At the r*** round, the players 
are constrained to choose positions in the sets /(r,s')(*-D+) and j+)- 


V{i-,s') Js'{i,i+) V{i+,s') 








(2) For the second game, the Spoiler’s first pebble and the first pebble of Duplicator are 
constrained to V{i,s') and V{j,s'). At the round, the players are constrained 
to play in the sets and I(^r,s')ij-, j+)- 
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■f(0,s') (*->*+) 






_ FO _ _ 


O' 

i 0 


*+ 


V{i,s') 


We say that positions x S i_|-) and y G I(^r,s')ij-^ j+) are locally equivalent if 

Duplicator can win the two restricted games when the pebbles are at these positions. 
The property presented in the following lemma can be deduced from the definitions and 
will be useful later. 

Lemma 9. Let an s-extraction. For every 0 ^ r ^ s, we have the following 

Js—r{f—^ J+ ) . 

We now prove that is a finite-index equivalence relation. This is a rather classical 
result for this type of object in finite model theory. We remark that the equivalent 
classes can be seen as the sets of true formulae for each triple in a logic adapted to the 
two restricted games. Thus, two triples would be equivalent if they satisfy the same 
formulae of quantifier depth less than s. As the number of formulae is finite, we can 
easily deduce that equivalence relation. 

Lemma 10. The relation '^g is an equivalence relation of finite index. 

We decompose this lemma in two intermediary result. 

Lemma. The relation ^g is an equivalence relation. 

Proof. The relation is clearly symmetrical and reflexive. Let x, y and z be triples 
forming an s-extraction such that x '^g y and y z. We now show that x '^g z. First 
we denote by Sr{x), Srijj) and Sr{z) the authorized positions for these triples at the r^^ 
round. We are going to play the following three games simultaneously with s' ^ s. 

(1) The first on Ss'{x) and Sg'ijj). 

(2) The second on Sgi{y) and Sg/{z). 

(3) The third on Sgi{x) and Sg>{z). 

For the first two. Duplicator has a winning strategy. We use it to construct a winning 
strategy for the third game. Let r ^ s' and assume that Spoiler plays si in Sr{x) on the 
third game at round r. We simulate Spoiler’s choice by playing a position si in Sr{x) 
in the first game. Duplicator then responds by following his winning strategy and by 
choosing a position S 2 in S 2 {y) for the first game. We then simulate Spoiler’s choice 
in position S 2 of Sr{y) for the second game. Once again. Duplicator answers with his 
winning strategy and chooses a position S 3 in Sr{z). Finally, we choose this position S 3 
to respond to Spoiler’s choice in the third game. 

By following Duplicator’s strategies, we immediately deduce that Duplicator also has 
a strategy for the third game. 

□ 


We now prove that this relation has finite index. 
Lemma. The equivalence relation ^g has finite index. 
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Proof. Let S = be an s-extraction with 

i- < i < i+ . 

Rather than introducing an artificial notion of logic adapted to the restricted games, we 
build inductively a notion of type to prove that this relation of equivalence has a finite 
index. We set r-Ts{x) to be the r-type of a position x in i+), defined as follows. 

• For all X in /(o,s) (*->*+) we set O-ts(x) the (t + 2) tuple of the binary values of 
predicates in the signature. More formally we have 

O-Ts(x) =(x < i,x > i, P^(x, x),... 

...,pHx,x)) e{0,ir+^ . 


• For 0 ^ r < s and all x in we set 

(r + l)-Ts(x) = ^(^C(x,y),r-T(y)^ | y € 

with C(x, y) the binary value of predicates P® between x and y. 

C{x,y) = {x <y,x> y, P^{x,y), P^{y,x),... 

...,P‘{x,j/),P*(j/,a:)) G{0,1}2*+2 ^ 

The s'-type of a triple S is the couple 

({s'-'rs(a;) | x G 4)}, {s'-'rs(a;) I x G y(i,s)}^ . 

By definition, there exists a finite number of s'-types of positions and so a finite number 
of s'-types of triples. By definition of the notion of type and by immediate induction 
we obtain that if (i_,i, 4 ) j+) have the same s'-type then (i_,z,i+) 

4)- Therefore has finite index. □ 

Ramsey’s Theorem is a combinatorial result of graph theory often used in finite 
model theory. Here we use a version adapted to hypergraphs. We introduce it in the 
context of triples, which is a direct reformulation of the 3-hypergraphs variant. This 
theorem establishes that for every large hypergraph with coloured edges, it is possible 
to extract a sufficiently large monochrome sub-hypergraph. This theorem allows us to 
hnd an arbitrarily large set of triples which are all pairwise equivalent for the relation. 
For a set E, we denote by VsiE) the set of pairwise disjoint triples of E. 

Theorem 11 (Ramsey’s Theorem for 3-hypergraphs [17)1. Let c be an integer. For any 
integer p there exists an integer n such that for any set S of size n and any function 
h: Ps^S) —>■ {1,... ,c} there exists a set E C S of size p such that h is constant on 
PsiF). 

A well-typed s-extraction is a set X that is an s-extraction and such that all the 
triples of X are equivalent for The following corollary is an immediate from Ramsey’s 
Theorem, in which c is the number of s-types of triples and h is the function that 
associates triple with their s-type. 

Corollary 12. For all integers p there exists a well-typed s-extraction of size p. 

We have now presented all of the tools necessary to present a proof of Theorem 01 
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5.3 Core of the proof 

Let L be a language with c as a neutral letter and definable in FO^[<,P^,... ,P*]. 
According to Theoreni[Tl there exists an integer s, such that for any words (u, v) G LxL^, 
Spoiler has a winning strategy for the two-pebble game with s rounds and m alternations 
for the signature {<, ,..., P^}. Let {u, v) in Lx be such a pair. We now construct 

a strategy for Spoiler using only the order and the successor. Let p = max(|u|, |n|) -|- 1. 
According to Corollary [TH there exists X = {io < ii ■ ■ ■ < ip}, which is a well-typed 

s-extraction. Let n = m.ax.V {ip, s), and let u' and v' be two words of length n and 

(/z)o^ 2 <|u |5 such that. 

• io < fo < fi < ■ ■ ■ < f\u\-i < f\u\ = ip, and io < go < gi <■■■ < 5 |„|_i < g|„| = 

• for all integers i, the positions fi and gi belong to X, 

• u}. = Ui, v'g. = v^, fo = go and = g\y\-i, 

• all unassigned positions of u' and v' are labelled by the letter c. 


C ■■■ C ■■■ C Uo ■■■£■■• Ui •••£■■■ c C ■■■ C 

b fo fi f\u\ — l f\u\ — 'ip 

C ■■■ C ■■■ C Vo ■■■€■■■ Vi ■■■ C ■■■ c ■■■ c ■■■ c 

v' -•-•-•-•-•-^- 

iQ go gi g\v\—i gi^i — 

If the words u and v are not of the same size, then that could give us fi gi- The words 
u' and v' are nothing other than the words u and v after inserting neutral letters such 
that the non-neutral letters are on X. We also require the first and last non-neutral 
letters to be in the exact same positions. 

As c is a neutral letter, {u',v') is in L x L'^. Therefore, Spoiler has a winning 
strategy for the two-pebble game over s-round and m-alternation and the signature 
{<, ..., P*}. We now have to construct Spoiler’s new strategy on {u, v). In order to 

do so, we simulate the game on {u', v') and construct via induction a winning strategy for 
Spoiler on {u,v). To achieve this step, we exploit a back-and-forth mechanism between 
the game on {u',v') and the game on {u,v). By following his winning strategy. Spoiler 
chooses a position on {u', v') which we translate into a position in {u, v). Duplicator then 
chooses a position in {u,v) which we translate on a position in {u',v'). We repeat this 
process until Duplicator can no longer respond in {u', v'). We must force Spoiler to play 
moves that are distant from one another so that his choices in {u', v') lead to a winning 
strategy on {u, v). If Spoiler’s new pebble is in a neighbourhood different to that of the 
previous pebble, then by construction of the neighbourhoods, the numerical predicates, 
with the exception of the order predicate, do not allow for a connection between the two 
positions; they do not transmit information. In the following section we always denote 
by ip (resp. jr) the position of the pebble played at the round r on u (resp. v). Likewise, 
we use i'p (resp. j}) for the position of the pebble at the round r on u' (resp. v'). 

For this construction to work. Spoiler should not win the game on {u',v') before 
he wins it on {u,v). This could however happen if Duplicator’s choices on {u',v') are 
not pertinent. We avoid this situation by selecting locally equivalent positions, that 
is, positions where Duplicator wins the restricted games introduced in the preceding 
section. Thus, Spoiler cannot win by choosing moves that are close to the old pebbles. 
He is therefore forced to play some distant moves. 

When Spoiler plays on an extremal position of the game on {u',v'). Duplicator can 
always respond at the same position on the other word. These moves therefore are of 
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no interest in Spoiler’s strategy. They are not used in the construction of the strategy 
of the game on (u,w). Each time Spoiler makes such a move, the game on (u,v) does 
not progress. More specifically, if the game has not started, the pebbles are not even 
placed and if the pebbles are already placed, they are not moved. 

We begin by describing the game’s first round, then we inductively build a strategy 
for the following rounds. For the first move. Spoiler’s winning strategy designates a 
position for the game on {u',v'). Through symmetry, we assume that this is a position 
on It'. We therefore distinguish two cases: 

1. This first move occurs within a segment of the form Js(/z)/z+i) for an integer 
0 ^ t < |m|. In this case, we choose to play on the position i on the game on (u, v). 
Duplicator then responds in the game on (u, v) by playing on u at a position j. If 
the letter that marks j is different from the one that marks z. Duplicator loses the 
game immediately. Otherwise, we have to simulate Duplicator’s response in the 
game on (u', v') by choosing a position in Js{gj, gj+i) that is locally equivalent to 
Spoiler’s first pebble. This is possible as the letters that mark fi on u' and gj on 
v' are equal, and (/i_i,/i,/i+i) {gj^i, gj, g^+i). 


J.U.J.+i) 



Js{9j^ 9j+i) 


i 



2. This first move is on an extremal position, that is smaller than min Js(/o,/i) = 

min Js(5o,ffi) or bigger than max Js(/|«|-i,/| m|) = max Js(5|,;|-i,5h|)- In this case, 
the back-and-forth process is degenerate since the game on (u, v) has not started 
yet. It starts when Spoiler plays on a non-extremal position. 

This kind of moves is not useful for Spoiler since Duplicator can only answer on the 
game on (u', v') by choosing the exact same position on the other word. As long as 
Spoiler plays on these extremal positions, it is sufficient for Duplicator to choose 
the exact same position. As Spoiler follows a winning strategy, he eventually plays 
inside a segment Js{fi, fi+i) for some integers 0 ^ z < |u|. Indeed, the extremal 
positions together with segments Js{fi, fi+i) split into a partition of all positions 
of the word (see Figure [T]). Therefore, we can assume to be in the preceding case. 

We now explain how to construct a winning strategy for Spoiler on (u, v) for the next 
rounds. We construct it inductively. We now assume to have played 1 ^ r < s rounds 
and that the pebbles of the preceding round are on positions v on u (resp. jV on v) as 
well as z(. on u' (resp. j' on v'). It is Spoiler’s turn to play. By induction, we assume 
the following properties to be satisfied: 

• If positions z(. and j' belong to (/i^_i,and to 9jr+i) then 

they are locally equivalent for at least one of the two constrained games at (s — r)- 
rounds (see Figure [2]). The first constrained game corresponds to the second case, 
and the second constrained game corresponds to the third case. 

• If this latter condition is not satisfied, then both pebbles have the exact same 
value, which is an extremal position on (u',v'). More precisely, zj, = j' and either 

zj, < min Js_r(/o,/i) = rmnJs-r{9o,9i) or zj. > max Js_r(/|„|_i,/|„|) = max Js-r(g|«|-i,5F|) • 
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-f(r,s)(/v-l,/i,+l) 


I.r-1 


/ir + 1 


v' 


Qjr-l 



k_ 

V" 


^{r-,s) fe-l.Sjr+l) 


S]r- + 1 


♦ 

jr 


• We assume the configuration of the game on {u', v') to be winnable for Spoiler: he 
has a winning strategy in less than (s — r) rounds. 

We are going to distinguish two cases. Either Duplicator is going to answer on Spoiler’s 
latest move in the game on {u, v) or Spoiler wins the game. Since we seek a winning 
strategy for Spoiler, we assume that Duplicator successfully answers on (u,u). If this 
is true, then we are going to find an adequate answer for Duplicator in the game on 
{u' ,v'). Since Spoiler has a winning strategy for this latter game. Duplicator eventually 
loses the game on [u', v') and therefore the game on (u, v). We remark that the number 
of alternations of the new Spoiler’s winning strategy on {u, v) is at most the one of his 
strategy on {u',v'). This concludes the proof. 

Nevertheless, it remains to be explained how we construct the position of Spoiler 
on {u,v) and how to deduce from a correct answer for Duplicator on {u,v), a correct 
answer for Duplicator on [u',v'). 

We use the Spoiler’s winning strategy on (u', v') to construct a new move for Spoiler 
on {u,v). Without loss of generality, we assume that this move is on u' and we denote 
by its position. We now distinguish four cases that only depend on the value of 
(see Figure[2|). Indeed, the segment {0,..., n — 1} is split into four parts that correspond 
to the four following cases: 

1. The first case corresponds to segments of the form Js-r-i{fk, fk+i) for k ^ ij. 
and k ^ ir-\- It includes almost all the positions of {0, ...,n} except extremal 
positions and a hole around positions and z(._i. 

2. The second case corresponds to the truncated segment to the left of the previous 

pebble on u'. This is the initial segment of the second constrained game for this 
position. More precisely it is the segment s — r — 1). 

3. The third case corresponds to the allowed positions for the constrained game 

around i[.. More precisely, it is the segment fir+i)- 

4. The last case corresponds to the extremal positions. They are the positions that 
are not handled by the other cases. They are either at the beginning or at the end 
of the word. 

The four cases deal with all the positions since the segments of the form Js-r-i{fk, fk+i) 
and the extremal positions form a partition of all the positions. Furthermore, by 
Lemma ini we have 

— — fir) Js — r — l{firTfir + l) ~ —^ ^ bJ dl(^r+l,s)i,fir — lj /v + l) ■ 

We now construct the back-and-forth strategy for each of the four cases: 

1. There exists an integer k different from v and v — 1 such that the position 
belongs to Js-r-i{fk, fk+i)- It is then sufficient for Spoiler to choose ir+i = k 
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old pebble position («^) 
new pebble potential positions 


*0 


left extremal positions 
case 0 


/o 


casein 

-f(r+l,s)(/v-l,/v+l) 







case 121 



case [2 


Figure 2: The four cases to deal with 


on u as its next move for the game on (u,v). We remark that all the predicates 
other than the linear order are evaluated to false between zj. and We assume 
Duplicator to be able to answer correctly at a position jV+i- We now choose a 
position on v' in the set Js_r-i(5jr+i) 5ir+i + 1) such that positions i'^+i and 
j'r+i locally equivalent for the first constrained game. This is possible since 
positions and are labelled by the same letter and because 

(/ir+l-l) /ir+l) /ir+l+l) (5>+l -1) ffjr+l+1) ' 

We remark that all predicates except for the linear order are evaluated as false 
between j' and Jr+i- Furthermore, the value of the order predicate between i[. and 
i'r+i is exactly the same as between v and ir+i which is also the same as between 
jr and jr+i and between j' and Since the letters labelling positions v+i on u 
and jr+i on v are the same, we deduce that position is correct for Duplicator. 
Consequently, the new configuration satisfies the induction hypothesis. 

2. We assume that belongs to V{fi^-i,s — r — 1). In this case, we choose 
Zr+i = Zr — 1, meaning that Spoiler plays on the position just to the left of ir- 
Since the successor relation is in the signature. Duplicator is also forced to play 
at the position immediately to the left. Here the very same arguments that in 
case [Hallow us to build a position so that the new configuration satisfies the 
induction hypothesis hold. The only difference, is that this time we are using the 
second constrained game, not the first. 


3. If belongs to /(r+i,s)(/i,.-i) /v+i)) then according to the induction hypothesis, 
Duplicator has a position in the set 7(^+1 ,s)5ir+i) which is locally 
equivalent to choosing this position and by setting v+i = ir and fr+\ = 

fr^ we obtain a new configuration that satisfies the induction hypothesis. We 
remark that in this case, the game configuration on (u, v) does not change. 


4. The last case is the one which i'^^x does not satisfy any of the preceding case. 
By construction, the positions of the words are split into segments Jg-rifk, fk+i) 
(resp. Js-r{gk, gk+i)) and the extremal positions. Therefore, if the integer z^+i is 
not treated by the other cases, then this position has to be extremal. That is to 
say 

< min Js_r-i(/o,/i) = miiiJs-r-i{go,gi) 


or 


i'r+x > max Js_r-i(/|u|_i,/|u|) = m.a^Js-r-iig\v\-i, g\v\) ■ 
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We choose for Duplicator on v\ as well as v+i = v and jr+i = jr- 

Therefore the game on (u, v) does not evolve and the new configuration satisfies 
the induction hypothesis. We remark that it is possible for fo be an extremal 
position but be handled by one of the preceding cases. For instance, if v belongs 
to Js-r{fo,fi) and if 


^r+l ^ ^(r+lys) (foj/l) D {0, . . . , min Js—r—l{foyfl)} , 

then Duplicator follows the first constrained game and it is therefore possible that 
ir+i ^ jr+1- In this particular case, since and are locally equivalent, the 
configuration still satisfies the induction hypothesis. 

As all the cases are treated, we have proved that as long as Duplicator answers correctly 
on {u,v), it is possible for him to answer correctly on {u',v'). Since Spoiler follows a 
winning strategy on {u',v'), Duplicator will eventually not be able to answer on (u,n). 
This concludes the proof. 


Acknowledgement 

I am grateful to Olivier Carton for all of his help and support, without which this paper 
would not have been possible. I also thank Michael Cadilhac, Amy Hadfield, and the 
anonymous reviewers for their contribution in improving a lot the final version of this 
paper. 


References 

[1] David A. Mix Barrington, Kevin Compton, Howard Straubing, and Denis Therien. 
Regular languages in NC^. J. Comput. System Sci., 44(3):478-499, 1992. 

[2] David A. Mix Barrington, Neil Immerman, Clemens Lautemann, Nicole 
Schweikardt, and Denis Therien. First-order expressibility of languages with neutral 
letters or: The Crane Beach conjecture. J. Comput. System Sci., 70(2):101-127, 
2005. 

[3] AshokK. Chandra, Steven Fortune, and Richard Lipton. Lower bounds for constant 
depth circuits for prefix problems. In Josep Diaz, editor. Automata, Languages and 
Programming, volume 154 of Lecture Notes in Computer Science, pages 109-117. 
Springer Berlin Heidelberg, 1983. 

[4] Shiva Chaudhuri and Jaikumar Radhakrishnan. Deterministic restrictions in circuit 
complexity. In Proceedings of the Twenty-eighth Annual ACM Symposium on the 
Theory of Computing (Philadelphia, PA, 1996), pages 30-36. ACM, New York, 
1996. 

[5] Merrick L. Furst, James B. Saxe, and Michael Sipser. Parity, circuits, and the 
polynomial-time hierarchy. Mathematical Systems Theory, 17(l):13-27, 1984. 

[61 Neil Immerman. Languages that capture complexity classes. SIAM J. Comput., 
16(4):760-778, 1987. 

[7] Michal Koucky. Circuit complexity of regular languages. Theory Comput. Syst., 
45(4):865-879, 2009. 


18 



[8] Michal Koucky, Clemens Lautemann, Sebastian Poloczek, and Denis Therien. Cir¬ 
cuit lower bounds via ehrenfeucht-fraisse games. In Proceedings of the 21st Annual 
IEEE Conference on Computational Complexity, CCC ’06, pages 190-201, Wash¬ 
ington, DC, USA, 2006. IEEE Computer Society. 

[9] Michal Koucky, Pavel Pudlak, and Denis Therien. Bounded-depth circuits: Sep¬ 
arating wires from gates. In Proceedings of the 37th Annual ACM Symposium on 
Theory of Computing, STOC ’05, pages 257-265, New York, NY, USA, 2005. ACM. 

[10] Andreas Krebs and Pierre Mckenzie. Private communication. 

[11] Andreas Krebs and A. V. Sreejith. Non-definability of languages by generalized 
Hrst-order formulas over (N,-|-). In Proceedings of the 27th Annual IEEE/ACM 
Symposium on Logic in Computer Science, LICS ’12, pages 451-460, Washington, 
DC, USA, 2012. IEEE Computer Society. 

[12] Andreas Krebs and Howard Straubing. An effective characterization of the alter¬ 
nation hierarchy in two-variable logic. In Proceedings of the 32th international con¬ 
ference on Eoundations of Software Technology and Theoretical Computer Science, 
ESTTCS ’12, pages 86-98, Dagstuhl, Germany, 2012. Schloss Dagstuhl-Leibniz- 
Zentrum fuer Informatik. 

[13] Manfred Kufleitner and Alexander Lauser. Quantifier alternation in two-variable 
hrst-order logic with successor is decidable. In Proceedings of the 30th International 
Symposium on Theoretical Aspects of Computer Science, STAGS ’13, pages 305- 
316. Schloss Dagstuhl. Leibniz-Zent. Inform., Wadern. 

[14] Manfred Kuheitner and Pascal Weil. The FO^ alternation hierarchy is decidable. 
In Computer science logic 2012, volume 16 of LIPIcs. Leibniz Int. Proc. Inform., 
pages 426-439. Schloss Dagstuhl. Leibniz-Zent. Inform., Wadern, 2012. 

[15] Leonid Libkin. Elements of Finite Model Theory. Springer, 2004. 

[16] Prabhakar Ragde and Avi Wigderson. Linear-size constant-depth polylog-threshold 
circuits. Inform. Process. Lett., 39(3):143-146, 1991. 

[17] Frank P. Ramsey. On a Problem of Formal Logic. Proc. London Math. Soc., S2- 
30(1):264, 1930. 

[18] Amitabha Roy and Howard Straubing. Dehnability of languages by generalized 
hrst-order formulas over (N,-b). SIAM J. Comput., 37(2):502-521 (electronic), 
2007. 

[19] Philipp Weis and Neil Immerman. Structure theorem and strict alternation hierar¬ 
chy for FO^ on words. Log. Methods Comput. Sci., 5(3):3:4, 23, 2009. 


19 



